WORLD INTELLECTUAL PROPERTY ORGANIZATION 
Inlcmational Bureau 




PCX 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) Intertutional Patent ClassiBcation 6 ; 




(11) International Publication Number: 


WO 97/26744 


H04M L^O, H04N 7/14 


A2 








(43) International Publication Date: 


24 July 1997 (24.07.97) 



(21) International Application Number: PCTyCA97/00029 

(22) International Filing Date: 17 January 1997 (17.01.97) 



(30) Priority Data: 

9600804.0 



17 January 1996 (17.01.96) GB 



(71)(72) Applicant and Inventor: ROBB. Garry. Douglas 
[CA/CA]; 4548 Lamboum Drive, Cobble Hill. British 
Columbia VOR ILO (CA). 

(74) Agent: BARRIGAR. Robert. H.; Barrigar & Moss, P.O. Box 
49131, 595 Burrard Street, Vancouver, British Columbia 
V7X IJl (CA). 



(81) Designated States: AL, AM. AT, AU, AZ, BA, BB, BG, BR, 
BY, CA, CH, CN, CU. CZ. DE, OK, EE, ES, FI, GB, GE. 
HU. IL. IS. JP. KE, KG, KP, KR. KZ, LC, LK, LR, LS, 
LT, LU, LV, MD, MG, MK, MN. MW. MX, NO, NZ, PL, 
PT. RO, RU. SO. SE, SG, SI, SK, TJ, TM, TR, TT, UA, 
UG, US, UZ, VN. ARIPO patent (KE. LS, MW, SD. SZ. 
UG), Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, 
TM), European patent (AT, BE, CH, DE, DK. ES. FI. FR 
GB, OR. IE, IT, LU, MC, NL, PT, SE), OAPI patent (BF. 
BJ, CF, CG, CI, CM, GA, GN, ML, MR. NE, SN, TD, TG). 



Published 

Without internationai search report and to be republished 
upon receipt of that report. 



(54) Title: MULTIFUNCTIONAL PORTABLE TELEPHONE 



(57) Abstract 



A personal interactive audio visual data entry system includes a hand held audio visual 
data entry unit having a camera reading sensor on a rotational pivot for sensing images in 
various positions, person to person MPEG-4 compatible low bit rate audio visual interactive 
communications algorithm, commands and/or data and for producing input signals in response 
to said sensed commands and/or data, rewritable storage for information relating to stored 
audio visual images and/or selectable items, a controller (a microprocessor or other processing 
circuitry) and PCMCIA and associated cinruihy and a display screen for displaying visual 
feedback and/or a uicr readable representation of the commands arKl/or $toi«d information 
for a selected item, and an automated tclecommunicabons interface for various methods of 
telephonic transmission of information relating to interactive audio visual communications 
and/or a selected item or items from said storage to a remote processing centre and for 
telephonic transmission of information relating to selectable items from said remote processing 
centre to said storage. The hand held unit can be configured to combine the data entry functions 
with those of audio visual telephony. 
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MULTIFUNCTIONAL PORTABLE TELEPHONE 

This invention relates to portable video teleconferencing systems, fwrtable data 
entry systems, portable computer systems, and to applications of such systems and 
equipment for use therewith. 

The present invention, known as the "Multiphone" is a multi-functional hand held 
portable device, vAdch provides a fully integrated video teleconferencing, data entry, and 
image capture system. A preferred embodiment of the "Multiphone" comprises of the 
following elements: 

• An adjustable and/or interchangeable reading head for capturing data and/or images. 

• A microphone and associated circuitry to eliminate much of the background noise to 
enable the capturing of audio data and/or voiced commands. 

• Rewritable storage for staring information relating to such captured data and/or 
images. 

• A controller to receive and process the input signals from the reading head and/or 
microphone, to respond to sensed commands, and to control the function of the 
Multiphone. 

• A display screen for displaying a representation of the captured data and/or images, 
and/or stored information. 

• A keypad and/or touch screen area to input commands and/or data. 

• A telecommunications interface for telephonic transmission and/or reception of 
information related to the captured data and/or images and/or stored information, to 
other compatible devices and/or remote processing centres. 

• A Radio Frequency (RF) interface for RF transmission and/or reception of infonnation 
related to the captured data and/or images and/or stored information, to other 
compatible devices and/or remote processing centres. 

• A standard RS232 interface for connection to other compatible devices, through a 
standard RS232 cablc and/or radio frequency (RF) link. 

• Multiple Personal Computer Memory Card International Association (PCMCIA) slots 
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to allow the loading of standard PCMCIA compatible Memory and Input/Output (I/O) 
peripheral cards into the device to increase its functionality. 

• Plug-in receptacles for a Video Display Unit (VpU) and a standard personal computer 
(PC) keyboard to allow the utilisation of the device in a similar fashion to a personal 
computer terminal. 

• Plug-in receptacle for an earphone device. 

The provision of the hand held unit having an integral reading head, controller, 
rewritable storage, display, touch screen area, keypad and telecommunications interface 
enables the unit to be used in an efficient and self-contained manner for the capture, 
processing, storage, display and transmission of data. In particular the inclusion of the 
display allows the user to verify and/or view the data being captured without taking his 
or her eyes off the areas in which data capture is taking place. 

In a preferred embodiment of the device, the telecommimications interface is 
integrated into the hand held unit and enables captured data and/or stored data and/or 
commands to be transmitted to and/or received from other compatible devices and/or 
remote processing centres via a telephone network. Preferably the telecommunications 
interface is an interface for coimection to a wireless telephony network, such as a cellular 
telephone network interfiEice. This provides for a particularly advantageous 
implementation of the invention, udiere the hand held unit can be operated in a similar 
fashion to a standard portable cellular phone, and can thus be used without the need to 
plug the device into, for example, a conventional wired telephone network. Cellular 
telephone networks are now common place and give a very wide area of coverage. This 
facilitates the use of the hand held unit in several convenient locations, for example, a 
user's home or woricplace. 

Alternatively, the telecommunications interfece can be a satellite telephone 
network interface, or some other form of wireless telephone interfece, for example a 
telephone interface for a telephone network based on highly localised transponder 
stations. Where the telecommunications interface is intended to interface with an 
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analogue telephone network, the telecommunications interface includes a modem. 



In other embodiments of the device the telecommunications interface could 
include radio frequency (RF) and/or optical transmitters and receivers, or indeed other 
types of transmitters and receivers. 

In a preferred embodiment of the device one or more standard PCMCIA card slots 
are incorporated into the hand held device to increase both its overall ftinctionality and 
flexibility. Consequently the hand held unit can utilise additional PCMCIA cards to 
achieve the desired functionality for the users potential application. 

PCMCIA cards can be divided into two functional categories. Memory and 
Input/Output (I/O) cards. Example types of each category are given below and include: 

Memory Cards containing one of the following technologies: 

• Masked ROM 

• Battery Backed SRAM 
. UVEPROM 

• One Time Programmable (OTP) ROM 

• EEPROM 

• FLASH PROM 



1/0 cards containing one of the following peripherals: 



• Loc2d Area Network Interfaces 

• FAX/Modems 

• Hard Disk 

• Cellular Phone Interfaces 

• Wireless Communications 

• 3270 Terminal Emulators 
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• Serial, Parallel and SCSI Ports 



• Imaging Cards 

• Data Encryption 

• Data Acquisition 



The provision of the hand held unit having one or more standard PCMCIA card 
slots consequently enables the unit to utilise PCMCIA cards to meet the memory and I/O 
requirements of any potential user ^plications. 

In a preferred embodiment of the invention an easily attachable and detachable 
rechargeable power source is included for connection to the device. An integrated and/or 
separate charger unit can then be provided with associated electrical connections for 
recharging the rechargeable power source. 

In some embodiments of the invention, the system can comprise a base imit 
separate from the hand held unit, wherein the base unit and the hand held unit are 
provided with a wireless data link which is operable for bi-directional data transfer 
between the hand held unit and the base unit, and wherein the base tmit includes a 
telecommunications interface for telephonic transmission of data and/or imziges and/or 
commands. In this embodiment the wireless data link preferably comprises, in the base 
imit and the hand held unit, radio frequency (RF) transmitters and/or receivers which 
allow a two way RF data link for transfening data from the hand held unit to the base unit 
and/or from the base unit to the hand held unit This transfer of data can consequently 
take place independently of wdiether the hand held unit is m the base unit or not In other 
embodiments it could comprise respective optical, rather than radio frequency, 
transmitters and receivers, or indeed other types of transmitters and receivers. 

A system comprising a hand held unit with or without a base imit as described 
above, can also include means for displaying a plurality of selectable items with 
associated data sources for user selection of an item by operation of the hand held unit 
and a remote processing centre for processing user selections transmitted from the hand 
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held unit. The controller in the hand held unit is preferably arranged to respond to 
appropriate commands input, for example via the reading head, to issue coded 
instructions via the telecommunications interface to the data processing centre and to 
receive programming data (e.g., relating to information for selectable items) from the 
progranmiing centre for storage in the hand held unit. 

In a preferred embodiment of the invention, the hand held unit includes a three 
way semi-lockable rotational pivot and/or a rotational reflective mirror(s) and/or an 
electronically manipulated substrate, ail of which can be electronically controlled and/or 
adjusted by an adjustable thumbwheel and/or keypad, either of which can both change 
the viewing position of the reading head and alter the primary fimction of the system. The 
rotational thumbwheel is preferably a small circular device which is located in a suitable 
and comfortable position on the top or side of the device preferably nearest the display 
screen. Depending on jthe viewing position of the reading head the device is programmed 
to serve various primary fimctions. 

Preferably the reading head has three positions: 

• In position 1 the reading head is in a vertical position and faces up to point at 
the user. 

• In position 2 the reading head is in a horizontal position and feces out 
horizontally £rom the user. 

• In position 3 the reading head is in a vertical position and faces down to point 
away from the user. 

In. a preferred embodiment of the hand held imit some potential applications for 
these three positions are: 

Position 1: Allows the capture of the end users fece to enable a video 
teleconferencing capability between another compatible device cither in the field, at home 
or place of work. This feature simply adds a better medium of communication compared 
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with on]y voice transmission. In this position the user would hold the device much like 
a calculator rather than a portable phone device and speak into the microphone. 



Position 2: Allows the user easy access to capture images to facilitate the 
identification of products and/or items and/or persons, for example information such as 
bar codes, dot codes, blob codes or in effect any suitably coded data or distinctive feature 
wiiich can be used for identification purposes. 

Position 3: Allows the user to capture data and/or images below the device while 
viewing the self same data and/or image on the display screen. The hand held units 
fimctionality is essentially the same as in position 2 however this position facilitates the 
capture of documents, fingerprints, and signatures, or any data and/or image pointed to 
by the user. With the inclusion of character or image recognition logic this allows 
graphical or alphanumeric data representations to be captured directly. This captured data 
and/or image can theri be stored and/or transmitted to other compatible devices and/or 
remote processing centres. Other potential devices include printers and fax machines, 
giving the fimctionality of a photocopier. 

In each position the controller in conjunction with associated lensing optimally 
determines the correct focusing to allow the correct capture of information and assists the 
user in obtaining a good read, wiiich is suitably indicated by a combination of audio 
and/or visual feedback. Thus, for example, vAiea information is correctly read, a beep can 
be sounded and a green indicator light illuminated, and when information is incorrectly 
read, two beeps could be sounded and a red indicator light illuminated. Alternatively, 
appropriate synthetic or recorded voice messages could be output and a visual indicator 
di^layed on the display screen. 

In a preferred embodiment of the invention, the hand held unit includes a keypad 
area to allow the user to input commands and data, or alter the operational states of the 
device to predetermined functions, e.g. pwwer-up and power-down. Furtheimore the 
keypad area can be complemented or replaced by a touch screen area which can fimction 
as a keypad and/or pen based scribing facility. 
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Preferably, there is provided a means for scrolling the display in four directions, 
up, down, left, and right to allow the display of more than one data item. The scrolling 
of the display enables a large number of items to be accessed with a relatively compact 
display. A number of alternative methods for scrolling the display can be incorporated 
into the hand held device, such as through the use of the touch screen and/or keypad 
areas, and/or voiced commands. 

Consequently a system in accordance with the invention, especially a system 
comprising a hand held unit including a telecommunications interface for use with a 
wireless telephony system, such as a cellular network telephone system, provides a 
particularly advantageous device for use, for example, for "home shopping". It enables 
the user to make shopping selections from a catalogue or from a series of options 
displayed on a television screen from the comfort of his or her home without the need to 
connect the device to a conventional telephone network. Additionally such a system finds 
particular application where the user of the system is travelling from place to place and 
may need to perform data entry functions when they are far from a conventional wired 
telephone network socket. 

The system as desoibed above preferably includes some form of user verification. 
This user verification can take many forms, such as a verification card (e.g., a credit carti, 
a smart card, a payment or other validation card), a personal identification number (PIN), 
a signature, a fingerprint, a voice signature, or any other such information which can be 
safely used for verification purposes. Consequently the operation of the hand held unit 
can be limited to suitably authorised users. 

Exemplary embodiments of the invention will be described heremafter, by way 
of example only, with reference to the accompanying drawings in which like reference 
numerals are used for like features and in which: 

Figures lA and IB are schematic views of a substantially rectangular shaped, 
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hand held device. 

J Figures 2A, 2B, 2C and 2D are schematic views of a base unit for use with the 
hand held device of Figures 1 A and IB. 

Figure 3 is a schematic block diagram of the functional elements of the first 
example of a hand held device as shown in Figures 1 A and IB. 

Figure 4 is a schematic block diagram of the fimctional elements of a telephone 
network interfece wiiich forms part of the hand held device as shown in Figures 1 A and 
IB. 

Figure 5 is a schematic block diagram of the functional elements of a PCMCIA 
Card for use with the hand held device of Figures 1 A and IB. 

i 

Figure 6 is a schematic block diagram of the functional elements of a clip-on 
enclosure for use with the hand held device of Figures lA and IB. 

Figure 7 is a schematic block diagram of the functional elements of a base unit 
as shown in Figures 2 A, 2B, 2C and 2D for use with the hand held device of Figtires 1 A, 
IB and 3. 

Figtirc 8 is an overview of a system comprising a plurality of hand held devices, 
such as is illustrated in the preceding Figures, linked via respective telephone connections 
to a Central Processing Unit. 

Figure 9 is a schematic block diagram of the functional elements of a further 
example of a hand held device as shown in Figures lA and IB implemented using an 
Application Specific Integrated Circuit (ASIC). 

Figure 10 is a schematic block diagram illustrating components in the ASIC 
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forming part of the apparatus of Figure 9. 

Figures 1 A and IB are schematic views from above and below respectively, of 
one embodiment of the hand held device which is substantially rectangular in shape and 
which will hereinafter, for reasons of conciseness only, be referred to as the "Multiphone 
20". The Multiphone 20 is intended to be held for essentially one handed operation in the 
palm of the hand, and grasped between the thumb and forefingers, in a similar manner 
to a standard mobile telephone. 

The Multiphone 20 has a rectangular body 1 1, in the present example, external 
dimensions are approximately 1 80mm by 70mm by 20mm (Height x Width x Depth 
respectively), although the dimensions may be larger or smaller as desired subject to 
technical limitations. An aerial 1 suitable for wireless communications connected to 
associated transmitter and receiver logic, and a reading head 2, for example a ceunera or 
infra-red optical reading head (e.g. laser diode), suitable for capturing data and/or images, 
arc located at one end of the Multiphone 20. Other types of reading head may be 
provided. The reading head is preferably interchangeable through the use of a clip-on 
enclosure 99, to allow the use of different types of reading heads. An adjustment 
thumbwheel 3, connected to the clip-on enclosure 99 by suitable means (e.g. a gearbox), 
allows the reading head to be adjusted to various woricing positions. 

On the upper surfece of the Multiphone 20 shown in Figure lA a display screen 
4, is provided to convey functional information to the user. The display screen prefiaably 
comprises a conventional two-dimensional colour array of pixels which can be selectively 
activated in order to provide the display of a wide range of displayable items. However, 
in a low cost version of the Multiphone 20, the display may be configured only to display 
a predetermined range of monochrome characters and symbols, this reducing the 
complexity of the display and the controlling logic and thus reducing the cost as will be 
well understood by one skilled in the art. 

Any suitable display technology can be used which enables the displayed 
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information to be read over a wide enough angular range such that it can always be read 
by the user when the Muluphone 20 is held at various angles suitable for capturing data 
and/or images. In this way it is not necessary to change the orientation of the Multiphone 
20 in order to read the display. 

A keypad area 6 and a touch screen area 12 are provided to allow the user to input 
commands and/or data. These areas are used to control the basic operation of the 
Multiphone 20. A removable stylus pen 28 is provided for use with the system to allow 
the touch screen area 12 to incorporate a pen based scribing facility. This pen is 
conveniently located in a retractable compartment 19 which is located in a suitable and 
comfortable position on the top or side of the device preferably nearest the top of the 
device. The user can also interact with the unit via the speaker 5, the microphone 9, and 
an earphone (not shovm) via the earphone plug-in receptacle 1 5. Additionally the unit can 
be connected to a Video Display Unit (VDU) (not shown) via the plug-in receptacle 13, 
a keyboard (not shown) via the plug-in receptacle 14, and a RS232 cable (not shown) via 
the plug-in receptacle 40. Various PCMCIA memory and I/O cards can be incorporated 
into the hand held unit through flie use of the PCMCIA slot(s) 10, as will be described 
in more detail later. 

The Multiphone 20 can be powered and recharged j&om a standard AC/DC power 
supply (not shown) vwth a suitable jack plug via the plug-in receptacle 16. On the 
underside of the Multiphone 20, shown in Figure IB, first and second electrical contacts 
7 and 8 and a removable battery cover 1 7 covering a battery compartment are suitably 
located. As an alternative to a compartment for removable batteries, a removable and/or 
fixed rechargeable battery pack could be provided instead. In all cases the electrical 
contacts 7 and 8 are conveniently arranged to co-operate with corrcspondmg contacts 24 
and 25 in the base unit 27, yet to be described, for charging the rechargeable batteries. 

In addition to the display 4 a set of indicator lights 18 and 39, (e.g. LED's), are 
used to advise the user on the correct usage and current operational state of the 
Multiphone 20. The indicator light 1 8 is used to report successful capture of data and/or 
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images, and is also used during video teleconferencing to indicate the correct usage of the 
device. The indicator light 39 is used to report when the Multiphone 20 is in the process 
of recharging its rechargeable batteries and is also used to inform the user when the 
batteries require to be recharged or replaced by flashing on and off repeatedly when the 
Multiphone 20 is in use. 

Turning now to Figures 2A, 2B, 2C, and 2D, which are schematic views from 
above, face on, side on, and again side on, respectively, of one embodiment of the base 
unit 27 for use with the Multiphone 20 of Figures lA and IB. 

The base unit 27 includes a generally rectangular housing 82 with two flanges 29 
and 30 which hold the Multiphone 20 in a resting position when the device is in the base 
unit. The resting position is also determined by the location/recharging platform 3 1 which 
contains the first and second electrical contacts 24 and 25. As previously stated these 

electrical contacts are conveniently arranged to co-operate with the corresponding 

1 

contacts 7 and 8 in the Multiphone 20 for charging the rechargeable battery (53, Figure 
3). The two flanges 29 and 30 ensure that when the Multiphone 20 is located in the base 
unit 27 that it is properly secured. Additionally the location/recharging platform 31 
provides sufficient clearance at the base of the Multiphone 20 to ensure contmued use of 
any PCMCIA cards which may be occupying the PCMCIA slot(s) 10. 

An indicator light 26 is used vAicn the rechargeable battery (53, Figure 3) in the 
Multiphone 20 is inserted in the base unit to indicate that the battery is charging. The 
rechargeable battery can be placed into the base unit on its own or when connected to the 
Multiphone 20. 

Electrical power is supplied to the base unit 27 6om a standard AC/DC power 
supply (not shown) via a power cable 21 with a suitable jack plug (not shown) plugged 
into the plug-in receptacle 38. The side of the housing 82 is also provided vrith a socket 
37 for a standard telephone plug for connecting the base unit 27 to a telephone line 22. 
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Fold away legs 33 and 35, which are connected to the base unit 27 via pivots 32 
and 34 respectively, allow the user to alter the viewing angle of the Multiphone 20 when 
located in the base unit 27. 



Figures 2C and 2D show schematics views of the base unit from side on to 
illustrate their fiinction. Leg 35 can be undipped from the main body of the base unit 27, 
and positioned via pivot 34. In doing so, the leg 33 can also be positioned via pivot 32 
and a semi-lockable sliding guide 36. 

An aerial 23 suitable for wireless communication, connected to associated 
transmitter and receiver logic, is located on the top of the base unit 27. This aerial 23 in 
conjunction with the aerial 1 located on the Multiphone 20, enables the wireless 
transferred of data between the base unit 27 and the Multiphone 20. 

Turning now to Figure 3, which is a schematic block diagram of the fimctional 
elements of the Multiphone 20. A processor 41 is preferably formed by a conventional 
programmable microprocessor (e.g., an Intel 8031, an Intel 80386, etc.), although a 
special purpose or specially configured unit (e.g., a Digital Signal Processor (DSP) 
and/or an ASIC) could alternatively be used (compare Figure 9). A read only memory 
(ROM) 42 is coimected via a bus 43 to the processor 41 for the storage of control 
programs, data and images. The ROM 42 can be implemented by any appropriate 
technology, for example by a flash PROM. A random access memory (RAM) 44 (for 
example a 128K low power static RAM, or higher capacity RAM, e.g., a 256K, 512K, 
5Mb, etc., RAM) is connected to tiie processor via the bus 43. The RAM 44 is used as 
working storage and for the storage of data and images captured using the camera 2. 

Signals relating to data captured by the camera 2 are passed via the camera 
interface 49 to the processor 41 to be processed. The camera interface 49 also provides 
the video CODEC 50 with a digital representation of the captured data from the camera 
2, where it can be suitably processed for display and/or telephonic transmission. 
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An indicator light 18, connected to the processor 41, is used to report successful 
capture of data and/or images from the Camera 2, and is also used during video 
teleconferencing to indicate the correct usage of the device 

The camera interface 49 carries out all the necessary signal conditioning as 
required on receiving signals from the camera 2. The signal conditioning will depend on 
the exact configuration of the camera and preferably comprises signal conditioning to 
enable accurate analogue-to-digital conversion (ADC), with sufficient buffering of the 
captured data as will be apparent to one skilled in the art. 

In a preferred embodiment of the device the camera 2 will include an integrated 
image sensing array and associated signal processing circuitry with all the necessary 
support circuitry to produce a fiilly functional camera delivering a fully formatted 
composite video signal and automatic exposure control. The camera 2 preferably also 
includes a processor for sensor control reduction, a voltage regulator for power supply 
control and an emitter-follower output buffer to directly drive a standard Video Display 
Unit (VDU). An example of such a camera is the WLl 063 miniattire monochrome on 
chip camera. 

The position of the camera 2 can be adjusted via flie thumbwheel 3 and/or a servo 
motor 65. The servo motor 65 is connected to the processor 41 via a servo controller 64. 
Consequently the user can alter the primaiy function of the Multiphone 20, as mention 
previously, via the thumbwheel 3 and/or the keypad 6. A more detailed discussion of the 
mechanical function of the servo motor 65 and thumbwheel 3 will be given with 
reference to the clip-on enclosure 99, which is described later in Figure 6. 

A keypad 6 is connected via a keypad interface 51 to the processor 41. An 
additional keyboard (not shown) can also be connected to the processor 41 via a keyboard 
interface 83 through the keyboard plug-in recqjtacle 14. The keypad 6 is also connected 
to a power control module (PCM) 52. This is because one of the keypad keys serves as 
a "power-up" key for turning the Multiphone 20 on or powering it up after it has been 
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powered down. The PCM 52 responds to the operation of this key in a powered down 
state to connect the battery 53 to the processor 4 1 . 

The PCM 52 also controls the charging of the main battery 53 and the backup 
battery 57 when the contacts 7 and 8 are connected to the corresponding contacts 24 and 
25 in the base unit 27, or when a standard AC/DC power supply jack is connected to the 
AC/DC power supply plug-in receptacle 16, which is also connected to the PCM 52. The 
indicator light 39 (e.g., an LED) is connected to the PCM 52 to indicate when the battery 
53 is being charged and is also used to inform the user when the batteries require to be 
recharged or replaced by flashing on and off repeatedly when the Multiphone 20 is in use. 

A display interface 45, which connects the displays 4 and 59 to the bus 43, 
responds to display instructions from the processor to drive the displays in a conventional 
manner. The display interface also incorporates the necessary logic to drive a standard 
Video Display Unit (VDU) via the VDU connector 13. 

A touch sensitive screen 12 for the display 59 is included in the Multiphone 20 
to incorporate a general purpose touch sensitive area. A touch screen interfece 62 couples 
the touch sensitive screen to the bus 43 so that data sensed by the touch sensitive screen 
can be communicated to the processor 41. Although Figure 3 shows a touch sensitive 
screen 12 (e.g., an overlay) separate fix)m a conventional display screen 59, any 
applicable touch sensitive screen technology can be used, either though the use of an 
addition to an existing conventional display screen, or the use of a display screen with 
integral touch sensitivity. One or more touch sensitive areas can be defined on the touch 
sensitive screen area, in combination with the data displayed on the display screen, for 
the entiy of commands and/or the selection of displayed items. In particular, the 
processor 41 can be arranged to display a menu of user selectable items and to be 
responsive to a location at which the screen is touched for input of a user selection of a 
menu item. The touch sensitive screen can then thus be used as a dynamic and 
reconfigurable user interface. Touch screen entry can be used in place of or in addition 
to the entry of commands from the keypad 6, and voiced commands. Additionally the 
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touch screen area can configured as a general purpose scribing area to allow the entry of 
data and written commands, and can be used for security purposes through the use of 
signature recognition. 

An audio interface 63 carries out all the necessary signal conditioning as required 
to output audio signals to the speaker 5 and earphone plug-in receptacle 1 5, and to receive 
audio signals from the highly sensitive microphone 9. In a preferred embodiment of the 
device the audio interface and/or the processor 41 will perform all necessary noise 
reduction. 

The Multiphone 20 can transmit and receive data via the RS232 interface 6 1 , the 
radio frequency (RF) interface 46 and the telephone network interface 58 as will be 
described in more detail below. In other embodiments of the Multiphone 20 the device 
can also include other interfaces such as a fibre optic interface and/or a standard parallel 
interface as will be appreciated by one skilled in the art. 

A standard RS232 connector 40, connected to the bus 43 via a RS232 interface 
61, is provided to allow the connection of other compatible devices to the Multiphone 20, 
through a standard RS232 cable and/or a radio frequency (RF) link. 

A radio frequency (RF) interface 46 is also connected to the bus 43 to convert 
data to be transmitted into signals for driving the RF transmitter 47, and converts signals 
firom the RF receiver 48 into data to be passed to the bus 43. The RF transmitter 47 and 
RF receiver 48 are connected to the aerial 1 , which focuses and converts RF energy for 
reception and transmission into space. This radio finequency interface 46 consequently 
enables wireless communication between the Multiphone 20 and any other compatible 
device over a limited range, typically 50 to 1 000 metres. 

A telephone network interface 58, incorporating transmitter and receiver logic 
designed to operate at higher firquencies, is connected to the bus 43 to allow wireless 
commtmication between the Multiphone 20 and any other compatible device over a 
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longer range, utilising a standard cellular and/or satellite network. The telephone network 
interface 58 is connected to the aerial 1. A more detailed discussion of the functional 
elements of the telephone network interface 58 is given later with reference to Figure 4. 

Since the transmitter and receive logic of both the RF interface 46 and the 
telephone network interface 58 utilise the same aerial 1, it is i>ecessary that the processor 
41 can control their operational states. Additionally since it is also essential that the aerial 
1 is designed to operate over a wide frequency range, an expandable and/or replaceable 
and/or interchangeable aerial can be suitably provided. 

The Multiphone 20 includes a PCMCIA controller 60 to manage the interface 
between the PCMCIA cards 84, 85, and 86, and the bus 43. The PCMCIA controller 60 
is connected to the PCMCIA cards 84, 85, and 86 via standard 68 pin PCMCIA 
connectors 54, 55, and 56. A PCMCIA pow«r interface (not shown), which is 
incorporated mto the power control module (PCM) 52, provides the PCMCIA cards 84, 
85, and 86 with all their necessary power and voltage requirements. 

In a preferred embodiment of the device the PCMCIA controller 60 will consist 
of a suitable chipset which is commonly available from several IC manufactures. 
Alternatively the PCMCIA controller 60 cari be implemented using a Field 
Programmable Gate Array (FPGA) and/or an Application Specific Integrated Circuit 
(ASIC), or indeed any other comparable technology. 

The processor 41 is programmed by means of control programs and data stored 
in the ROM 42 and in use, in the RAM 44, to receive signals from the camera interfece 
49, to interpret those signals and to derive data therefiwm which are displayed on the 
display 4 and which can be stored in the RAM 44 or any suitable PCMCIA memory 
devices occupying one or more of the PCMCIA slots 54, 55, or 56. 

Figure 4 illustrates in more detail the telephone network interface 58 shown 
previously in Figure 3. The telephone network interface 58 comprises a duplexer 69 
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which is connected to an aerial 1 . The duplexer 69 is connected to a transmitter 66 and 
to a receiver 67, the function of which are synchronised by the coordinator 68. Both the 
transmitter and the receiver support both analogue FM and digital time division multiple 
access (TDMA) schemes. The transmitter 66 converts the audio signal to a radio 



aerial 1 focuses and converts RF energy for reception and transmission into space. The 
transmitter receives a suitably conditioned audio signal from the microphone 9, whilst 
the receiver transmits an audio signal through the speaker 5 and/or earphone socket 15, 
all via the audio interface 63 (not shown). 

Figure 5 is a more detailed schematic block diagram of the ftmclional elements 
of the PCMCIA Card 84 for use with the Multiphone 20 as shown in Figures 1 A and IB. 
The PCMCIA Card 84 consists of three fimctional elements: 

• PCMCIA Card Interface 87 '] 

• Memory or Peripheral Logic 88 

• Card Information Structure (CIS) ROM 89 

The PCMCIA card interface 87 of the PCMCIA card 84 contains all the necessary 
elements required to implement the desired fiinctionality of the PCMCIA card and 
typically contains the following blocks: 

• PCMCIA Configuration Registers 

• Bus Intafece Logic 

• Address Buffers 

• Data buffers 

• EPROM Control 

• Common and Attribute Memory Control 

• Application Specific Functions 

In PCMCIA memory cards the Memory or Peripheral Logic 88 often consists of 



frequency (RF) signal, and the receiver 67 converts an RF signal to an audio signal. The 
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memory only and seldom needs additional logic, whilst in PCMCIA I/O cards the 
Memory or Peripheral Logic 88 is logic intensive and is usually implemented through the 
use of a manufactures chipset which is placed onto the card using small package types. 

The Card Information Structure (CIS) ROM 89 is a memory block on the card 
that tells the host device what fiinction the card is to perform. This is a bjrte-wide PROM 
that exists on every PCMCIA card. 

Figure 6 is a more detailed schematic block diagram of the fiinctional elements 
of the clip-on enclosure 99 for use with the Multiphone 20 as shown in Figures 1 A and 
IB. The clij>-on enclosure 99 houses a camera 2 which is mounted on a rotational printed 
circuit board (PCB) 91 centrally located on a pivotal axis 98. The rotational PCB 91 is 
connected to the Multiphone's motherboard 100 through electrical connectors 117 and 
90 via a flexible electrical circuit ribbon 1 18. 

A servo motor 65, controlled by the processor (4 1 , Figure 3) via a servo controller 
(64, Figure 3), can be used to rotate the rotational PCB 91 through 1 80° into three distinct 
functional positions. Additionally a thumbwheel (3, Figure 3), connected to the main 
body of the Multiphone 20, can be used to rotate the rotational PCB 91 through the use 
of a gearing mechanism (not shovim) wiiich is incorporated into the clip-on enclosure 99. 

In each functional position, respective iensing 93, 94, and 95, incorporated in the 
lens body 96, assists in the correct focusing of the camera 2. Each lens 93, 94, and 95 is 
manufectured to meet the particular functional reqmrements of their respective positions, 
as mentioned previously. The camera 2 is also shrouded from incoming ambient light by 
the camera shroud 92 which is connected to tiie rotational PCB 91. The camera shroud 
92 may incorporate one or more light sources 97 (e.g. LED's, and/or Laser Diodes) to 
assist the user in obtaining a good read. 

Figure 7 is a schematic block diagram of tiie functional elements of the base unit 
27 of Figures 2A, 2B, 2C and 2D. A power control module (PCM) 1 01 is supplied with 
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electrical power from a standard AC/DC power supply (not shown) via a power cable 2 1 
with a suitable jack plug (not shown) plugged into the plug-in receptacle 38. The PCM 
101 is connected to first and second electrical contacts 24 and 25 so that, when the 
Multiphone 20 is located in the base unit 27, the rechargeable batteries 53 and 57 can be 
recharged. An indicator light 26 is connected to the PCM 101 and is used to indicate that 
the rechargeable batteries 53 and 57 are charging. The PCM 101 also supplies power to 
the other elements of the base unit 27 via supply lines which are represented 
schematically (for reasons of drawing simplicity) by the arrows 103. 

It will be appreciated that in addition to the use of a standard AC/DC power 
supply for use with the Multiphone 20 and base unit 27 an adapter for connection to, for 
example, a 12 volt E>C supply from a car may also be provided. 

A modem 102 is connected via a radio fi^quency (RF) interface 110 to a RF 
receiver 108 and a RF transmitter 109. The RF interface 1 10 converts signals from the 



RF receiver 108 to data to be passed to the modem 102 and converts data from the 
modem 102 to signals to be transmitted by the RF transmitter 109. A firrther interface 
(e.g. a standard RS232 interface - not shown) for connection to a personal computer (not 
shown) could also be provided. Also a socket for a connection to a standard telephone 
handset (not shown) could be provided. The modem 102 can be a conventional modem 
generally comprising a master control unit 106, a data pump 107 and memory 104. The 
master control unit 106 is coimected to receive data fitam the RF interface 1 10 (and/or 
fix>m a RS232 interfece, if a personal computer is coimected). Data from the data pump 
107 is coupled via a line interface 105 to the telephone line 22 via a standard telephone 
socket 37. The data piunp 107 can also be coimected via an audio interface (not shown) 
to a Sf>eaker (not shown) for monitoring the transmission of data via the telephone line 



Figure 8 is a schematic representation of a system comprising a plurality of 
Multiphone imits 20 connected via respective telephone connections 22 (telephone lines, 
wireless telephone channels, etc.) to a Central Processing Unit 1 1 1. In this system data 



22. 



19 



SUBSTITUTE SHEET (RULE 26) 




wo 97/26744 PCT/CA97/00029 

and/or images, and/or stored information can be transmitted and received between the 
individual Multiphones/base units 20/27 and the Central Processing Unit 111. In a 
preferred embodiment of the invention, the Multiphones/base units 20/27 are used for the 
placing of orders for merchandise and the Central Processing Unit 1 1 1 processes those 
orders and dispatches them to the users. Additionally the Central Processing Unit 1 1 1 can 
be used to transmitted and/or receive the following information: 

• Update information relating to merchandisable items. 

• Software and/or firmware programs for use with the Multiphone 20. 

• Still or motion images. 

Clearly this list is not exhaustive and as such any information suitable for 
transmission via a telephone network can be transmitted and'or received. 

In a preferred embodiment of the Multiphone 20 the software stored in the ROM 
(42, Figure 3) permits the loading of d at a fix»m the central processing unit or another 
compatible remote device. The programming is performed using a series of commands 
preceded by dot codes. The programming commands are thus known as "dot" commands 
and cover a number of standard operations as will be apparent to one skilled in the art 
In this way, a significant amount of catalogue data and/or program software and/or 
images can be held m the central processing unit and be sent to the Multiphone 20 as and 
when required. Where programs are to be downloaded, rewritable program storage will 
be needed in the Multiphone 20, for example by implementing the ROM (42, Figure 3) 
in flash PROM technology. 

Preferably there is a security system implemented in the Multiphone 20 to prevent 
the unauthorised updating of data. One such security system can be implemented through 
the use of data encryption. In this system each Multiphone 20 is issued vnth a unique 
encryption key from a central processing unit and/or the service provider. Consequently 
data to be transmitted to that device is encrypted using that devices own specific 
encryption key. Consequently only that ^)ecific Multiphone 20 can successfully receive 
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and decode this transmitted data. As an additional security method the encryption key of 
each Multiphone 20 can be updated by the central processing unit and/or the service 
provider at will and/or on each occasion the Multiphone 20 is in contact with the central 
processing unit and/or service provider. This can be implemented through the use of 
rewritable program storage in the Multiphone 20, for example by implementing the ROM 
(42, Figure 3) in EEPROM technology. 

The embodiment of Figure 9 is implemented using an Application Specific 
Integrated Circuit (ASIC), although a conventional microprocessor and external hardware 
could be used. Likewise, it will be appreciated that the embodiments described with 
reference to the previous Figures could also be implemented using an ASIC or other 
equivalent technology instead of a microprocessor (e.g. a Digital Signal Processor 
(DSP), and/or Field Programmable Gate Array (FPGA)). 
i 

In the embodiment of Figure 9, the ASIC performs the majority of the necessary 
processing functions of the device including: 

• accepting data from the camera 2. 

• processing the data received from the camera 2. 

• controlling an interface to the camera 2, the functions of the camera interface 
49 being performed in the ASIC. 

• controlling a servo controller 64 connected to a servo motor 64, the functions 
of the servo controller 64 being performed in the ASIC. 

• accepting data from the keypad 6. 

• controlling an interface to the keypad 6, the functions of the keypad interface 
51 being performed in the ASIC. 

• accepting data from the optional personal computer (PC) keyboard (not 
shown) via plug-in receptacle 14. 

• controlling an interface to a standard Personal Computer keyboard (not 
shown), the functions of the keyboard interface 83 being performed in the 
ASIC. 
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• driving the indicator 18. 

• controlling the flow of data in and out of the RAM 44. 

• controlling the flow of data in and out of the ROM 42. 

• controlling the flow of data in and out of the video CODEC 50, the functions 
of the video CODEC 50 being perfortned in the ASIC. 

• interfacing with the power control module 52. 

• implementing the modem fiinction for use with an analogue telephony system 
and also providing the necessary processing and control for integration with 
a digital telephony system and/or cellular telephone network. 

• controlling the loudspeaker 5 and earphone via the earphone plug-in 
receptacle 15, permitting the progress of calls to be monitored. 

• accepting input from a microphone 9 to enable the Multiphone in 
cornbination widi the camera 2 and loudspeaker 5 and earphone (not shown) 
to operate as a hand set for the purposes of audio and/or visual telephony. 

• controlling an interface to the displays 4 and 59 and VDU connector 13, the 
functions of the display interfece 45 being performed m the ASIC. 

• controlling an interface to the touch screen 12, the functions of the toiich 
screen interface 62 being performed in the ASIC. 

• controlling an interface to an RF transmitter 47 and RF receiver 48 to enable 
the wireless transfer of data via an RF link to another compatible device, the 
functions of Ae RF interface 46 being performed in the ASIC. 

• controlling an interfece to a RS232 connector 40, the functions of the RS232 
interface 61 being performed in the ASIC. 

• controlling a PCMCIA controller 60 connected to the PCMCIA cards 84, 85, 
and 86, the fimctions of the PCMCIA controller 60 being performed in the 
ASIC. 

Figure 10 illustrates in more detail the configuration of the ASIC 1 12. 
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The ASIC comprises the system controller 113 that controls the operation of the 
Multiphone 20 and of its associated components. In this embodiment the system 
controller 113 consists of a microcontroller core incorporated into the ASIC. In other 
embodiments it could consist of some other control means using, for example, one or 
more finite state machines. 

The microcontroller receives requests via the internal bus 1 16 ■wiiich is connected 
to the external bus 43 illustrated in Figure 9. However, in an altemative embodiment 
where the system controller 1 1 3 consist of a number of finite state machines, then control 
would be by means of the fixed intercoimection of the logic in the fixed state machines. 

If the system controller 1 13 is a microcontroller core, then the data that controls 
its operation is stored in an internal ROM 114 together with the external ROM 42. 
Alternatively, there could be no internal ROM 114 and the system controller 113 will 
then obtain all the data from the external ROM 42. Alternatively, again, the internal ROM 
114 could be used exclusively without an external ROM 42. However, this would reduce 
the flexibiUty of the device. The use of the internal ROM 1 14 is advantageous where a 
pre-defined amount of the operations to be performed are fixed for all Multiphone 20 
types, whilst the remainder of the operation is dependent on a particular model, to take 
account for example of language variations, methods used to enter data, etc Tbe internal 
RAM 1 1 5 in the ASIC can be used by the system controller 1 13 as a scratch pad RAM 
to speed up operations and in order to reserve tiie maximum amount of external RAM 44 
for the storage of the main data. This "main data" includes such data as catalogue data 
and/or program software and/or images which can be down-loaded by telephonic 
transmissions fix)m a central processing unit. 

The internal RAM 115 could be used as a short term data store leavmg the 
external RAM 44 to store the main data, the data in external RAM 44 being retained by 
the battery 53. An additional backup battery 57 is provided for data retention to prevent 
the loss of data fix)m the external RAM 44 or the internal RAM 1 1 5 in the event of failure 
of the battery 53. 
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Signals reiating to data captured by the camera 2 are passed via the camera 
interface 49 to the system controller to be processed. The camera interface 49 also 
provides the video CODEC 50 with a digital representation of the captured data from the 
camera 2, where it can be suitably processed for display and/or telephonic transmission. 

An indicator light 18, connected to the system controller 1 13, is used to report 
successful capture of data and/or images firom the Camera 2, and is also used during 
video teleconferencing to indicate the correct usage of the device 

The camera interface 49 carries out all the necessary signal conditiomng as 
required on receiving signals fi:om the camera 2. The signal conditioning will depend on 
the exact configuration of the camera and preferably comprises signal conditioning to 
enable accurate analogue-to-digital conversion (ADC), vnth sufficient buffering of the 
captured data as will be apparent to one skilled in the art. 

The system controller 1 13 can electronically adjust the position of the camera 2 
by controlling the servo motor 65 via the servo controller 64. Consequently the user can 
alter the primary function of the Multiphone 20, via the keypad 6. 

The keypad interface 51 responds to the operation of the keypad 6 and ensures 
that the system controller 1 13 receives appropriate signals as required by the particular 
key pressed. The keypad interface 51 also ensures that this signal is devoid of bounce 
(e.g. resulting fiom the multiple operation of a key due to the spring operation within the 
key mechanism). An additional keyboard interface 83, which serves the same function 
as the keypad interface 5 1 , allows the system controller 1 1 3 to receive appropriate signals 
from a standard Personal Computer (PC) keyboard. 

The system controller 1 13 is interfaced with and receives electrical power from 
the power control module (PCM) 52. 

A display interface 45 enables the system controller 1 13 to drive the displays 4 
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and 59 in a conventional manner and also incorporates the necessary logic to drive a 
standard Video Display Unit (VDU) via the VDU connector 13. 



A touch screen interface 62 enables the system controller 1 13 to sense data from 
the touch sensitive screen 12 as described previously with reference to Figure 3. 

An audio interface 63, which is controlled by the system controller 113, carries 
out all the necessary signal conditioning required to allow the microphone 9, the speaker 
5 and earphone plug-in receptacle 1 5 to provide standard audio telephony transmission 
or to allow the system controller 1 13 to transfer the data over the telephony network 
using, in the present embodiment, conventional cellular telephone technology. 

The audio interface 63 thus enables the Multiphone 20 to be used as a 
conventional cellular telephone for the transmission of audio signals. In conventional 
telephony mode the system controller 1 13 receives signals from the microphone 9, via 
the audio interface 63, and performs all the necessary digital signal processing (DSP) 
operations required to transmit the signal over a telephone network. These digital signal 
processing operations can comprise, as will be apparent to one skilled in the art, 
conventional operations of buffering the microphone 9 to filter out any frequencies which 
are not required for transmission (e.g. any introduced noise and distortion). The system 
controller 1 13 then directs this processed signal to the telephone network interface 58 to 
be transmitted. Received audio data fmm the telephone network interface 58 is directed 
via the system controller 11 3 to the audio interface 63 which performs all the necessary 
signal conditioning to pass the signal to the speaker 5 and earphone pli^-in receptacle 15. 

hi the data transfer mode, the telephone network interface 58, which incorporates 
transmitter and receiver logic, allow wireless communication between the Multiphone 
20 and any other compatible device, utilisuig a standard cellular and/or satellite network. 
The telephone network interfiace 58 is connected to the aerial 1, which focuses and 
converts RF energy for reception and transmission into space. The functional elements 
of the telephone network interface 58 where discussed previously with reference to 
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Figure 4, and as such will not be discussed again here. 

A standard RS232 connector 40, is connected to the system controller 1 13 via a 
RS232 interface 61, to allow the connection of other compatible devices to the 
Multiphone 20, through a standard R5232 cable and/or radio frequency (RF) link. 

A radio frequency (RF) interface 46 is also incorporated into the ASIC 112 to 
convert data to be transmitted into signals for driving the RF transmitter 47, and converts 
signals from the RF receiver 48 into data to be passed to the system controller 113. The 
RF transmitter 47 and RF receiver 48 are connected to the aerial 1 , which again focuses 
and converts RF energy for reception and transmission into space. This radio frequency 
interface 46 consequently enables wireless coirunimication between the Multiphone 20 
and any other compatible device. 

Lastly the ASIC 112 incorporates a PCMCIA controller 60 to manage the 
interface between the PCMCIA cards 84, 85, and 86, through the PCMCIA connectors 
54, 55, and 56. 

Although specific embodiments of the invention have been described 
hereinabove, it will be appreciated that several modifications and/or additions are 
possible within the scope of the present invention. 

It can be ^preciated that other forms of interfeces can be incorporated into the 
hand held unit to utilise various forms of data transmission (e.g. a fibre optic interface). 

As an example, additional elements can be incorporated into the hand held unit 
to enable the recq^tion of television transmissions via various wire and/or wireless 
transmissions (e.g. via telephone lines, fibre optic cables, UHF and satellite 
transmissions) to allow both the vievring of standard television pictures on the display 4 
and/or a video display unit (VDU) and/or a standard television. These television pictures 
can also be compressed and stored in a suitable medium (e.g. a PCMCIA memory card) 
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in the Multiphone 20 and/or a central processing unit. These stored television pictures can 
then be decompressed on demand and viewed on the display 4 and/or a VDU and/or a 

standard television to enable a form of video on demand. The television transmissions 

(I 

can also be used to allow the rapid updating of data held in the Muhiphone's internal and 
external memory. 

Furthermore it can be appreciated that the hand held unit can be designed to 
incorporate additional elements such as frequency adjustment logic to allow for the 
wireless transmission and reception of data over a much wider j&iequency range (e.g. from 
500 Hz to 10 GHz) as required by various potential user applications. In such cases it is 
conceived that a multi-fimctional and/or additional aerial would be required. 

Although in the presently preferred embodiments described above both the hand 
held unit and base unit are configured to be substantially rectangular in shape, it will be 
appreciated that both units could be configured in other shapes as desired by other 
applications. It will also be appreciated that it may be desirable and/or necessary to 
change the position of each constituent clement of both the hand held unit and base unit 
to maximise such design factors as reliability, maintainability, and ergonomics. 
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I CLAIM: 



1) A persona] interactive audio visual audio data entry system comprising a hand 
held audio visual data entry unit, said hand held unit comprising a camera reading sensor 
on a rotational pivot for sensing images in various positions allowing interactive 
communication, MPEG-4 compatible audio video coder that is designed for audio visual 
communication over the GSM digital cellular network using a low bit rate audio visual 
interactive communications algorithm which allows various forms of wireless 
commuiucations , commands and/or data and for producing input signals in response to 
said sensed commands and/or data, rewritable storage and/or PCMCIA ports and 
associated controller for information relating to selectable items, a controller connected 
to receive and process said input signals from said sensor for responding to said 
commands to control said hand held unit and/or to said data to select a said item and a 
display screen for displaying a user readable representation of said conunands and/or 
stored information for said selected item, and a telecommunications interface for 
telephonic transmission of information relating to interactive audio visual 
communications and selected item or items from said storage to a remote processing 
centre and for telephonic transmission of audio visual information and/or information 
relating to selectable items from said remote processing centre to said storage. 

2) A personal interactive audio visual data entry system according claims I, wherein 
said telecommunications interfece is integral to said hand held unit. 

3) A personal interactive audio visual data entry system according to claim 2, 
x^etein said hand held unit includes a rechargeable power source, means being provided 
for recharging said power source. 

4) A personal interactive audio visual data entry system according to claim 3, 
comprising a base unit separate from said hand held unit, v^iierein said base unit includes 
a charger unit and said base unit and said hand held imit arc provided with respective 
interconnectable electrical coimectors for recharging said rechargeable power source. 
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5) A personal interactive audio visual data entry system according to any one of the 
preceding claims comprising a base unit separate from said hand held unit, wherein said 
base unit and said hand held unit arc provided with an automated wireless data link which 
is opyerable for bi-directional data transfer between said hand held unit and said base unit, 
and wherein said base imit includes a said telecommunications interface for telephonic 
transmission of information relating to interactive audio video and/or a selected item or 
items from said storage to a remote processing centre and for telephonic transmission of 
information relating to selectable items from said remote processing centre to said 
storage. 

6) A personal interactive audio visual data entry system according to claim 5, 
wherein said wireless data link comprises, in said base unit and said hand held unit, 
optical transmitters and/or receivers which cooperate when said hand held imit is in said 
rest position to provide a two way optical data link for transferring data from said hand 
held unit to said base unit and/or from said base unit to said hand held unit. 

6) A personal interactive audio visual data entry system according to any one of the 
preceding claims, wherein said telecommunications interlace is an interface for 
connection to a wireless telephone network. 

7) A personal interactive audio visual data entry system according to claim 7, 
wherein said telecommimications interface is a cellular telephone network interface. 

8) A personal interactive audio visual data entry system according to claim 7, 
wherein said telecommunications interface is a satellite telephone network interface. 

9) A personal interactive audio visual data entry system according to any one of the 
preceding claims, wherein said telecommunications interfece includes a modem. 

10) A personal interactive audio visual data entry system according to any one of the 
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preceding claims, wherein said hand held unit comprises one or more manually operable 
switches for scrolling said display in a first and/or second direction for selectively 
displaying information for respective selectable or selected items from said storage. 

11) A personal interactive audio visual data entry system according to claim 10, 
wherein operation of said switches in predetennined operational states of said hand held 
unit causes predetermined functions other than scrolling functions to be performed. 

12) A personal interactive audio visual data entry system according to any one of the 
preceding claims, wherein said display comprises a touch/stylus sensitive screen, said 
controller being arranged to display a menu of user selectable items and to be r^onsive 
to a location at which said screen is touched for input of a user selection of a said menu 
item. 

13) A personal interactive audio visual data entry system according to any one of the 
preceding claims comprising a reading sensor for reading coded data, wherein said 
controller is arranged to access the stored information for selectable items to determine 
natural language characters or images corresponding to the coded data for display. 

14) A personal interactive audio visual data entry system according to claim 13, 
wherein said coded data comprises product identification codes and sensing circuitiy for 
such images, and/or text. 

15) A personal interactive audio visual data entry system acconiing to any one of 
claims 1 to 14, wherein said reading sensor is a camera. 

1 6) A personal interactive audio visual data entry system according to any one of the 
preceding claims wherein said display has a substantially rectangular display screen. 

17) A personal interactive audio visual data entry system accorxlmg to any of the 
preceding claims, comprising means enabling audio and or audio visual telephone 
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conversations with a remote station. 

18) A personal interactive audio visual data entry system according to claim 17 
wherein said hand held unit includes a speaker and/or microphone and switching means 



19) A personal interactive audio visual data entry system according to any one of the 
preceding claims wherein said hand held unit is configured as a device which is held 
much like an electronic calculator and operated much like a mobile telephone wherein 
the user speaks at the device as the interaction takes place viewing another user using a 
similiar device. 

20) A personal interactive audio visual data entry system according to any one of the 
preceding claims wherein said reading sensor is located in a mtiltifimctional pivitol 
reading head which is reieasably attached to said hand held imit. 

21) A personal interactive audio visual data entry system according to any one of the 
preceding claims additionally comprising separate firom said hand held unit: 

means for displaying a plurality of selectable items with associated data sources 
for user selection of an item by operation of said hand held unit; and 

a remote processing centre for processing user selections transmitted from said 
hand held unit. 

22) A persona] interactive audio visual data entry system according to any one of the 
preceding claims, wherein said band held unit is programmable remotely from said 
processing centre with information relating to secure operation in regards to data 
transmissions. 

23) A merchandising system comprising a personal interactive audio visual data entry 



permitting said hand held unit to be used as a telephone handset. 
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system according to claim 21 or claim 22, wherein: 

said selectable items are raerchandisable items; and 

said remote processing centre initiates processing of user orders of said selectable 
merchandisable items. 

24) A personal interactive audio visual data entry system according to any one of 
claims 1 to 22 or a merchandising system according to claim 23 comprising a verification 
device in the form of a fingereprint and/or audio facial verification identity via the 
camera and associated circuitry. 

25) A personal interactive audio visual data entry system according to any one of 
claims I to 24 or a merchandising system according to claim 23 or claim 24 comprising 
a carrier for a plurality of data and/or command codes for association with means for 
displaying a plurality of selectable items, wliercin said carrier canries a plurality of codes, 
each for a respective one of a plurality of natural language and/or numeric characters and 
a plurality of commands for controlling operation of said data entry or merchandising 
system, each code being associated with a visual representation of the corresponding 
natural language or numeric character or command and/or of a graphical representation 
thereof. 

26) A personal interactive audio visual data entry system or a merchandising system 
according to claim 25 wherein said codes are associated in any way to product 
identification. 

27) A personal interactive audio visual data entry system substantially as hereinbefore 
described with reference to the accompanying drawings. 

28) A personal interactive audio visual merchandising system substantially as 
hereinbefore described with reference to the accompanying drawings. 
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29) A personal interactive audio visual data entry system vAth associated circuitry 
allowing multiple fimctionalty via a multiple port PCMCIA. 
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